Reply to Huszár: The elastic weight consolidation penalty is empirically valid
نویسندگان
چکیده
منابع مشابه
On Quadratic Penalties in Elastic Weight Consolidation
Elastic weight consolidation [EWC, Kirkpatrick et al., 2017] is a novel algorithm designed to safeguard against catastrophic forgetting in neural networks. EWC can be seen as an approximation to Laplace propagation [Eskin et al., 2004], and this view is consistent with the motivation given by Kirkpatrick et al. [2017]. In this note, I present an extended derivation that covers the case when the...
متن کاملEmpirically Valid Rules for Ill-Defined Domains
Ill-defined domains such as writing and design pose challenges for automatic assessment and feedback. There is little agreement about the standards for assessing student work nor are there clear domain principles that can be used for automatic feedback and guidance. While researchers have shown some success with automatic guidance through apriori rules and weak-theory structuring these methods ...
متن کاملFluid Pipelines: Elastic Circuitry without Throughput Penalty
In chip design, pipeline depth and cycle time are fixed early in the design process but their impact on physical design can only be assessed when the implementation is mostly done, making it impractical to change such parameters. Elastic Systems are insensitive to latency, and thus enable changes in the pipeline depth late in the design time with low effort. Nevertheless, current Elastic System...
متن کاملIs the Persian Version of the “Olfactory Disorder Questionnaire” Reliable and Valid?
Introduction: The Questionnaire for Olfactory Dysfunction (QOD) is a self-reporting olfactory-related quality of life questionnaire. The aim of this study was to determine the reliability and validity of the Persian version of this questionnaire. Materials and Methods: One hundred and thirteen patients with olfactory problems were enrolled in this study. The English version of the QOD was first...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the National Academy of Sciences
سال: 2018
ISSN: 0027-8424,1091-6490
DOI: 10.1073/pnas.1800157115